Spin nematic order in multiple-spin exchange models on the triangular lattice 



Tsutomu Momoi,^ Philippe Sindzingre,^ and Kenn Kubo'^ 

'Condensed Matter Theory Laboratory, RIKEN, Wako, Saitama 351-0198, Japan 
^Laboratoire de Physique Theorique de la Matiere Condensee, UMR 7600 of CNRS, 
Universite P. et M. Curie, case 121, 4 Place Jussieu, 75252 Paris Cedex, France 
^Department of Physics and Mathematics, Aoyama Gakuin University, 
5-10-1 Fuchinohe, Sagamihara, Kanagawa 229-8558, Japan 
(Dated: November 30, 2011) 

We figure out that the ground state of a multiple-spin exchange model applicable to thin films 
of solid '^He possesses an octahedral spin nematic order. In the presence of magnetic field, it is 
deformed into an antiferro-quadrupolar order in the perpendicular spin plane, in which lattice 
rotational symmetry is also broken. Furthermore, this system shows a narrow magnetization plateau 
at half, m/msat = 1/2, which resembles recent magnetization measurement [H. Nema et al, Phys. 
Rev. Lett. 102, 075301 (2009)]. 

PACS numbers: 75.10.Jm, 75.40.Cx 



Frustrated quantum antiferromagnets have long been 
a subject of active research since Anderson sug- 
gested that a spin-1/2 Heisenberg antiferromagnet on 
the triangular lattice would have a gapless spin liq- 
uid ground state named as resonating-valence-bond 
(RVB) state. Recent experimental studies of quasi- 
two-dimensional compounds, such as solid '^He films ab- 
sorbed on graphite [3-5], the organic Mott insulator [g] k- 
(BEDT-TTF)2Cu2(CN)3 and the transition metal chlo- 
ride CS2CUCI4 0, have further prompted theoretical re- 
search of quantum spin liquid and competin g ex otic or- 



ders in triangular lattice antiferromagnets [8h14|. 



Among these, solid "^He films offer a perfect realization 
of a spin-1/2 triangular lattice. They contain a unique 
character in spin exchange interactions. The nearest- 
neighbor interaction is ferromagnetic (FM) and com- 
petes with antiferromagnetic (AF) multiple-spin cyclic 
exchange 3, iBl- As such, '^He on graphite belongs to 
a new class of quasi-two dimensional systems to exhibit 
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"frustrated ferromagnetism" 
in the possibility of tuning the ratio of the competing 
interactions continuously by varying the density of '^He 
atoms. An additional strong motivation for understand- 
ing this system comes from the fact that, for a range of 
densities bordering on ferromagnetism, spins in solid '^He 
films exhibit anomalous double-peak structure in specific 
heat 4] with gapless excitations ^]. 



The effective Hamiltonian for nuclear magnetism of 
■^He thin films is given by the = 1/2 multiple-spin ex- 
change (MSE) model on the triangular lattice [l5|. The 
Hamiltonian containing up to six-spin exchanges and ap- 



plied field is written as 

^ o 

(1) 

where Pn denotes the cyclic permutation operator of n 
spins. The summations in front of the permutation op- 
erators run over all minimal n spin clusters. The first 
and the second summations, for example, run over all 
pairs of nearest neighbors and all four-spin diamond clus- 
ters, respectively. In solid '^He on graphite, the effective 
two-spin coupling J is negative (FM) and the other cou- 
plings J„ (n = 4,5,6) are positive. Experimental esti- 
mates suggest that two-spin and four-spin exchange in- 
teractions are dominant, but five-spin and six-spin inter- 
actions are also not small [l^]- We set J — —2 and the 
ratio Je/Jb = 2 throughout this letter. 

Magnetism induced by multiple-spin exchange on the 
triangular lattice has been studied mostly in the J-J4 
model which contains two-spin and four-spin ex- 

changes. When FM J strongly competes with AF J4, 
it was found that, in a finite range bordering on ferro- 
magnetism, three magnon bound states become the most 
stable magnetic particles, giving rise to an octupolar or- 
dered phase in applied magnetic field IJ]. However the 
nature of the ground state in the absence of magnetic 
field was not identified in this regime. When four-spin 
exchange J4 is dominant, exact diagonalization analysis 
concluded a quantum disordered state with a large spin 
gap 12, [13]. The strong J4 also supports a wide mag- 
netization plateau at half of saturation {m/msat = 1/2), 
which originates from the appearance of four-sublattice 
spin density wave with uuud structure [^, [ll|, [l3| ■ 

In this letter, we study S" = 1/2 MSE model on the 
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FIG. 1: Director configurations in spin nematic order in 5 = 
1/2 MSB model on the triangular lattice. Ellipses on bonds 
represent nematic-directors. In the applied field (a), only spin 
transverse components are depicted and there are also induced 
uniform dipole moments on sites. At zero field (b), three types 
of director vectors are orthogonal to each other. 
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FIG. 2: Magnon instabilities to the fully polarized state 
at the saturation field. Parameters are set as J = — 2 and 
Je = 2J5. The wave vectors in the Brillouin zone (F, K, W, 
defined in the inset) and some space symmetries are shown. 
FM denotes the stable ferromagnetic phase. 



triangular lattice containing up to six-spin exchange cou- 
plings [Eq. ([T|)], which is directly applicable to solid '^He 
films. Inclusion of these multiple spin exchanges helps 
us to identify that the ground state is an octahedral 
spin nematic state [Fig. (Hb)], which has both liquid- 
like character and antiferro-quadrupolar orders on bonds. 
In applied field, this spin state is continuously deformed 
into a spin nematic state with antiferro-quadrupolar or- 
der [Fig. [ija)], where lattice Z3 rotational symmetry is 
also broken. This state is understood as condensation of 
d + id-wave two magnon bound states. 

The occurrence of this spin state may indeed be most 
easily understood from the channel of magnon instabil- 
ity at saturation field. As shown in Fig. [51 magnon 
pairs form stable bound states in a wide range near the 
FM phase boundary. As previously seen |19l42lj . con- 



densation of bound magnon pairs leads to a spin ne- 
matic state [22| , which has quadrupolar order in the per- 
pendicular component to the applied field and breaks 
the U{1) symmetry of the Hamiltonian. In the tri- 
angular lattice J-J4 model (i.e. J5 = Jq — Q), in- 
stabilities given by two magnon bound states [20[ and 
three magnon bound states [l^ are competing. Inclu- 
sion of five and six-spin exchange interaction removes 
this competition, making the dx^_y2 + idxy-wave two 
magnon instability most dominant in a wide parame- 
ter range near FM phase boundary, as shown in Fig. [21 
The d + id-wave magnon pairing operators are given by 



i+el 



and 



'i+e2 + i "^i "^1+61-62) 

its complex conjugate where j — exp(i27r/3) and 
ei = (1,0), 62 = (l/2,^/3/2). The parameter set 
estimated in the 4/7 phase of two-dimensional (2D) solid 
•^He also belongs to this instability region. 

The d + id-wsLYe bound magnon pairs Q±|FP), where 
|FP) denotes the fully polarized state, are degenerate 
with chiral degrees of freedom as the eigenvalues to the 
space rotation by 27r/3 are i?27i-/3 = Ji J^- In such a case, 
strong repulsion between different species of bosons can 
induce density imbalance between the condensates of two 
species, breaking additional chiral Z2 symmetry. 

To identify the nature of symmetry breaking, we have 
performed numerical exact diagonalization of Eq. ([1]) for 
clusters up to TV = 36 spins. For parameter sets in the 
two-magnon instability regime, the special stability of 
lowest energy states in even S sector at large magneti- 
zation (high S states), as seen in Fig. \Mjo), signals the 
formation of bound magnon pairs with repulsive interac- 
tions, which leads to jumps by |AS'| = 2 in the magneti- 
zation process as shown Fig. [3] and points to spin nematic 
ordering in the perpendicular spins [21 1 . 

From the analysis of irreducible representations (ir- 
reps) and quasi-degeneracy of these low-lying states, we 
conclude to non-chiral spin nematic ordering. A quasi 
three-fold degeneracy is observed in low-lying states in 
the even spin S sector (for S < mg — 2), instead of the 
two- fold degeneracy expected for the chiral nematic. It 
indicates that bound magnon pairs with different chiral- 
ities condense with the same density and an additional 
Z3 symmetry is broken. 

The order parameter of this non-chiral nematic state 
is identified as 



(7(1) 



Q+-Q-= ^V3J2iSrSr,^^ SrSr,J, (2) 



by expansion of the coherent state exp[— AC'j/(i)] |FP) into 
irreps, which gives the numerically observed irreps. The 
required low-lying states for this order are listed in Ta- 
ble|l](a). Note that space rotational Z3 symmetry is bro- 
ken in this order parameter, corresponding to the choice 
of two bonds out of three. A schematic figure of nematic- 
directors for this state is depicted in Fig. [IJa). The 
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FIG. 3: Magnetization process m/iris of the MSB model for 
= 36 spin cluster. The exchange parameters are J = —2, 
Js = ^ Je = 0.15 with (a) J4 = 0.75 and (b) J4 = 0.8. Jumps 
of \Am\ — 2, corresponding to spin nematic order, are clearly 
visible. In (b), a narrow plateau structure appears at m/ms — 
1/2. 
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TABLE I: Irreps of low lying states in each total spin S (mag- 
netization m) sector, needed for antiferro-quadrupolar order- 
ing, (a) in applied field and (b) at zero field. The symbols are 
defined as Fi = (i?a7r/3 = 1, Rn = 1, o = 1), Fa = (-Rair/s = 

\, Rt, = \, (T = -1), F3 = (i?3^/3 = j,f 

of them have the wave vector fe = (0, 0). 



Rtx — 1), and all 



ground state manifold has spin [/(1)/Z2 symmetry and 
space Z3 symmetry. 

In the absence of magnetic field, SU{2) symmetry is 
restored and the signature of SU (2) symmetry breaking 
is the existence of an "Anderson tower" of quasidegener- 
ate joint states (QD JS) belonging to different spin sectors 
which form the N = 00 ground state with energies scaled 
as Eqjjjs ^ ^^^]^^^ and are well separated (at finite N) 
from the lowest magnon excitations (scaled as ^ 1/Vn). 
The energy spectrum around S' = is shown in Fig. HJa) 
for the parameter set J = —2, J4 — 0.5, J5 — Jq — 0. A 
similar spectrum structure is also found for finite J5, for 
example in J = —2, J4 = 0.8, J5 = ^ Jg = 0.15. The spin 
5 = 1 sector has high energy, which excludes conven- 
tional spin ordering. Comparing irreps of the low energy 
states with those expected for various possible spin struc- 
tures, we found that these states perfectly match with the 
Anderson tower of a spin nematic state with three sets of 
orthogonal directors, whose order parameter is given by 



O 



5(7(2) 



- > IQr(ei) + Qf (e2) + gr (ei - e^)}, (3) 



<D 
LU 



(a) 



-117 



-118 





i 


1 ± 1 1 1 i- 


M — 








i 


X 


B= 




: A 


A - 

s© 













/\- 






A 












r, 






X r2 






A 


X 




- Others 



(b) 
-90 



-100 



-110. 





1 ■ 1 ' 1 

-O: 




e - 


- 


A : 


; § 

-a" 


I.I.I 



10 
S(S+1) 



20 



10 12 14 16 18 
S 



where Qf"{r) = 5f ^f. 



FIG. 4: (Color online) Energy spectrum of the MSE model 
for TV = 36 spin cluster with (a) J = —2, J4 — 0.5, J5 = 
Je ~ near the singlet (S = 0) and (b) J = —2, J4 — 1, 
J5 = ^Je ~ 0.3 near the saturation (5* = 18). The symbols 
Fi, Fa, and F3 are defined in Table H] 



This order parameter has octahedral spin symmetry 
O, if one combines spin transformations with the space 
group Cqv of the triangular lattice. To obtain irreps spe- 
cific to this spin state, one may decompose the irreps 
of SU(2) into irreps of O in each spin S sector [23| and 
remove irreps odd under tt rotation (Cf), i.e. the three 
dimensional irreps Fi and F2 , which should be absent as 
the nematic order parameter is invariant under Cf (since 
directors are headless). This allows projection only on 
Ai, A2, and E. For = 36 spins, Ai, A2, and E map 
onto Fi, F2, and F3 of Cgw, respectively (F^ are defined 
in Table HI). The irreps for TV = 36 in each spin S sector 
are shown in Table HUb), which agrees well with symme- 
tries of QDJSs found in Fig. lUJa). The mapping of Ai 
and A2 to Fi and F2 may interchange depending on the 
number of spins TV. (Note that, only the relative sym- 
metries between QDJSs are important for constructing 
symmetry broken states). With this assignment, irreps 
around S = smoothly connect with those of low-lying 
states determined by the two-magnon instability at sat- 
uration field. While the dynamics of the order param- 
eter of a non-coUinear Neel is that of a symmetric top, 
which has 25" -I- 1 states in each total spin S and mag- 
netization m sector, here the ground state manifold has 
spin SU{2)/ D2 symmetry and so the Anderson tower has 
S/2 + 1 [{S - l)/2] states for even (odd) S sector, the 
same as a symmetric top which are even under tt rota- 
tions around the principal axes. 

In applied field, two orthogonal nematic directors be- 
come perpendicular to the field and the other doesn't 
have any order in the perpendicular plane, leading to the 
space Z3 symmetry breaking. The QDJSs around S = 
smoothly merge with the series of low-lying states at high 
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FIG. 5: Phase diagram of the MSE model in m/nisax = 1/2. 
The exchange parameters are set as J = — 2 and Je = 2J5. 
Spin nematic phase spreads over most of the "non- plateau" 
region. 



magnetization. Thus the octahedral spin nematic state 
at zero field is continuously deformed into the spin ne- 
matic state under the field. 

The order parameter Cs(7(2) has the same spin symme- 
try as the antiferro-quadrupolar (AFQ) state discussed in 
the triangular lattice S = 1 bilinear-biquadratic model 
H m. The irreps of QDJSs for the S* 1 AFQ 
state, obtained from the decomposition of the wave func- 
tion [2^, are equivalent to the Anderson towers of the 
5 = 1/2 octahedral spin nematic state at zero field, 
through the mapping of the space groups. The difference 
is that the quadrupolar moments exist on bonds in the 
5 = 1/2 spin nematic state, whereas on sites in the 5 = 1 
AFQ state. In 5 = 1/2 spin nematics, 5 = 1 degrees of 
freedom are formed on bonds and moving around from 
bond to bond. The ground state is translationally in- 
variant at any field, i.e., it doesn't show any spin density 
wave, which is also different from the 5 = 1 system [25j . 
Thus, the_5_= 1/2 spin nematic state has a liquid-like 



character [2lJ, |27| and cannot be decoupled into the site 
product state. On the other hand, the 5 = 1 AFQ state 
is formed by the product of the quadrupolar moments 
localized on sites, having three sublattice structure with 
the wave vector k = (47r/3, 0). 

The signature of spin nematic ordering in energy spec- 
trum around 5 = was well detected in a wide parameter 
range J5 < 0.2 which covers the (i + id- wave two-magnon 
instability region at saturation field slightly extending 
to the smaller J4 regime. In most of the region, the spin 
nematic state exists from zero magnetization to the satu- 
ration. Near J5 = Jg = regime, three magnon instabil- 
ity induces an octupolar order under magnetic field [l^ . 
but, at very low magnetization, the octahedral spin ne- 
matic order overcomes it, as shown in Fig. IH^a). For the 
J5 > 0.3 range, there is no more clear separation of QD- 
JSs and also no signature of spin ordering. 

Meanwhile, a wide magnetization plateau appears at 



m/nis = 1/2 due to the sp in-g apped uuud state in 
the strong J4 regime S El Ell • Recent magnetiza- 
tion measurement in 2D solid '^He observed a narrow 
plateau structure at m/rris = 1/2 28|. To compare with 
this, we numerically obtained magnetic phase diagram 
in m/rrLs — 1/2 (Fig. [SJ. The uuud phase is easily de- 
tected by the four-fold quasi degenerate low-energy states 
and a large energy gap above them. As shown in Fig. [SJ 
the plateau phase spreads close to the FM phase bound- 
ary. Near its edge, the magnetization process has a very 
narrow plateau at m/ms = 1/2 [see Fig. |3{b)], which re- 
sembles the experimental observation. Even in this case, 
spin nematic phases appear in both low and high mag- 
netization regime. 

To summarize, strong competition between FM two- 
spin and AF multiple-spin interactions on the triangular 
lattice induces the octahedral spin nematic state with 
bond antiferro-quadrupolar order. This state is a strong 
candidate for explaining the anomalous magnetic behav- 
iors experimentally observed in 2D solid '^He. 
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